Papers by Rohit Pratap Singh
English to Hindi Multi-modal Neural Machine Translation and Hindi Image Captioning (D19-52)
Copied to clipboard
| Challenge: | Multi-modal translation is an emerging task of the MT community, where visual features of image combine with textual features of parallel source-target text to translate sentences. |
| Approach: | They propose to use convolutional neural net-works and visual geometry to extract image features and attention-based Neural MachineTranslation (NMT) system for translation. |
| Outcome: | The proposed multi-modal translation system improves translation quality and improves the quality of the captions of the images. |